Head tracking eyewear system

ABSTRACT

In some embodiments, a system for tracking with reference to a three-dimensional display system may include a display device, an image processor, a surface including at least three emitters, at least two sensors, a processor. The display device may image, during use, a first stereo three-dimensional image. The surface may be positionable, during use, with reference to the display device. At least two of the sensors may detect, during use, light received from at least three of the emitters as light blobs. The processor may correlate, during use, the assessed referenced position of the detected light blobs such that a first position/orientation of the surface is assessed. The image processor may generate, during use, the first stereo three-dimensional image using the assessed first position/orientation of the surface with reference to the display. The image processor may generate, during use, a second stereo three-dimensional image using an assessed second position/orientation of the surface with reference to the display.

PRIORITY CLAIM

This application claims priority to U.S. Provisional Patent ApplicationNo. 61/561,687 entitled “HEAD TRACKING USING EYEWEAR WITH FIVE REFLECTORPOINTS” filed on Nov. 18, 2011, which is incorporated by referenceherein.

RELATED APPLICATIONS

This application is related to U.S. patent application Ser. No.13/019,384, entitled “MODIFYING PERSPECTIVE OF STEREOSCOPIC IMAGES BASEDON CHANGES IN USER VIEWPOINT” filed Feb. 2, 2011, which is acontinuation-in-part of U.S. patent application Ser. No. 11/429,829,entitled “THREE DIMENSIONAL HORIZONTAL PERSPECTIVE WORKSTATION” filedMay 8, 2006, which claims priority to U.S. Provisional PatentApplication No. 60/679,633, entitled “THREE DIMENSIONAL HORIZONTALPERSPECTIVE WORKSTATION” filed May 9, 2005, each of which areincorporated by reference herein. This application is related to U.S.Patent Application No. 61/426,448, entitled “THREE-DIMENSIONAL TRACKINGOF OBJECTS IN A 3-D SCENE” filed Dec. 22, 2010, which is incorporated byreference herein. This application is related to U.S. Patent ApplicationSer. No. 61/426,451, entitled “THREE-DIMENSIONAL COLLABORATION” filedDec. 22, 2010, which is incorporated by reference herein.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present disclosure generally relates to tracking systems. Moreparticularly, the disclosure generally relates to systems and methodsfor tracking a position of a human head in relation to a display system.

2. Description of the Relevant Art

Three dimensional (3D) capable electronics and computing hardwaredevices and real-time computer-generated 3D computer graphics have beena popular area of computer science for the past few decades, withinnovations in visual, audio, tactile and biofeedback systems. Much ofthe research in this area has produced hardware and software productsthat are specifically designed to generate greater realism and morenatural computer-human interfaces. These innovations have significantlyenhanced and simplified the end-user's computing experience.

Ever since humans began to communicate through pictures, they faced adilemma of how to accurately represent the three-dimensional world theylived in. The answer is three dimensional illusions. The two dimensionalpictures must provide a number of cues of the third dimension to thebrain to create the illusion of three dimensional images. This effect ofthird dimension cues can be realistically achievable due to the factthat the brain is quite accustomed to it. The three dimensional realworld is always and already converted into a two dimensional (e.g.height and width) projected image at the retina, a concave surface atthe back of the eye. And from this two dimensional image, the brain,through experience and perception, generates the depth information toform the three dimensional visual image from two types of depth cues:monocular (one eye perception) and binocular (two eye perception). Ingeneral, binocular depth cues are innate and biological while monoculardepth cues are learned and environmental.

Perspective drawing, together with relative size, is most often used toachieve the illusion of three dimensional depth and spatialrelationships on a flat (two dimensional) surface. Of special interestis the most common type of perspective, called central perspective.Central perspective, also called one-point perspective, is the simplestkind of “genuine” perspective construction, and is often taught in artand drafting classes for beginners. Using central perspective, the chessboard and chess pieces look like three dimensional objects, even thoughthey are drawn on a two dimensional flat piece of paper. Centralperspective has a central vanishing point, and rectangular objects areplaced so their front sides are parallel to the picture plane. The depthof the objects is perpendicular to the picture plane. All parallelreceding edges run towards a central vanishing point. The viewer lookstowards this vanishing point with a straight view. When an architect orartist creates a drawing using central perspective, he must use asingle-eye view. That is, the artist creating the drawing captures theimage by looking through only one eye, which is perpendicular to thedrawing surface.

The vast majority of images, including central perspective images, aredisplayed, viewed and captured in a plane perpendicular to the line ofvision. Viewing the images at an angle different from 90° would resultin image distortion, meaning a square would be seen as a rectangle whenthe viewing surface is not perpendicular to the line of vision.

Central perspective is employed extensively in 3D computer graphics, fora myriad of applications, such as scientific, data visualization,computer-generated prototyping, special effects for movies, medicalimaging, and architecture, to name just a few. One of the most commonand well-known 3D computing applications is 3D gaming, which is usedhere as an example, because the core concepts used in 3D gaming extendto all other 3D computing applications.

There is a little known class of images called “horizontal perspective”where the image appears distorted when viewing head on, but displays athree dimensional illusion when viewing from the correct viewingposition. In horizontal perspective, the angle between the viewingsurface and the line of vision is preferably 45°, but can be almost anyangle, and the viewing surface is preferably horizontal (thus the name“horizontal perspective”), but can be any surface, as long as the lineof vision forms a non-perpendicular angle to it.

Horizontal perspective images offer realistic three dimensionalillusions, but are little known primarily due to the narrow viewinglocation (the viewer's eyepoint has to coincide precisely with the imageprojection eyepoint) and the complexity involved in projecting the twodimensional image or the three dimension model into the horizontalperspective image.

The generation of horizontal perspective images requires considerablymore expertise to create than conventional perpendicular images. Theconventional perpendicular images can be produced directly from theviewer or camera point. One need simply open one's eyes or point thecamera in any direction to obtain the images. Further, with muchexperience in viewing three dimensional depth cues from perpendicularimages, viewers can tolerate a significant amount of distortiongenerated by the deviations from the camera point. In contrast, thecreation of a horizontal perspective image does require muchmanipulation. Conventional cameras, by projecting the image into theplane perpendicular to the line of sight, would not produce a horizontalperspective image. Making a horizontal drawing requires much effort andis very time consuming. Further, since humans have limited experiencewith horizontal perspective images, the viewer's eye must be positionedprecisely where the projection eyepoint point is in order to avoid imagedistortion. A system which tracked a viewer's eye relative to ahorizontal display might then adjust the projection eyepoint point tominimize or avoid image distortion.

Conventional head tracking system are adequate for recognizing a changein the head position, but are not precise for precise operations appliedto a personal workstation. Furthermore, as a user moves their head toone side or another for look-around capabilities, The norm of using tworeflector points could lose recognition of one of the two reflectorpoints (the turn of the head may move one of the reflector point out ofview of the camera detector).

Another major problem in reflector based head tracking is falsepositives. this is where there may be more reflections detected by thesensor than are intended to be identified. As an example in usingeyewear, the reflectors are to reflect the intended infrared (IR) light,but additional reflections off the glass surfaces of the eyewear may bedetected by the camera sensor and be interpreted as incorrect intendedreflections and therefore confuse the positioning detection system.

Therefore a system and/or method which better results in tracking of theposition of the head or more precisely, where the eyes are on the head,would further insure the perspective of the viewer to the display iscorrectly maintained and would be highly desirable.

SUMMARY

This disclosure describes systems and methods for, in some embodiments,tracking with reference to a three-dimensional display system mayinclude a display device. The display device may image, during use, afirst stereo three-dimensional image. The system may include an imageprocessor. The system may include a surface including at least threeemitters. The surface may be positionable, during use, with reference tothe display device. The system may include at least two sensors. Thesensors may be coupled to the display device in a known position andorientation with reference to the display device. At least two of thesensors may detect, during use, light received from at least three ofthe emitters as light blobs when the light blobs from the at least threeemitters of the surface are detected substantially in proximity to thedisplay device during use.

The system may include a processor coupled to at least two of thesensors. The processor may assess, during use, a referenced position ofthe detected light blobs using a bounding function for each of at leasttwo of the sensors. The processor may correlate, during use, theassessed referenced position of the detected light blobs for each of atleast two of the sensors such that a first position/orientation of thesurface with reference to the display device is assessed. The imageprocessor may generate, during use, the first stereo three-dimensionalimage using the assessed first position/orientation of the surface withreference to the display. The image processor may generate, during use,a second stereo three-dimensional image using an assessed secondposition/orientation of the surface with reference to the display.

BRIEF DESCRIPTION OF THE DRAWINGS

Advantages of the present invention may become apparent to those skilledin the art with the benefit of the following detailed description of thepreferred embodiments and upon reference to the accompanying drawings.

FIG. 1 depicts a diagram of a view of an embodiment of a tracking devicefor tracking a head of a user relative to a display system.

FIG. 2 depicts a diagram of a perspective view of an embodiment of asystem for tracking a head of a user relative to a display systemwherein light is detected emanating from all of the emitters.

FIG. 3 depicts a diagram of a perspective view of an embodiment of asystem for tracking a head of a user relative to a display systemwherein light is detected emanating from only some of the emitters.

FIG. 4 depicts a diagram of a perspective view of an embodiment of asystem for tracking a head of a user relative to a display systemwherein light is detected emanating from only some of the emitters.

FIG. 5 depicts a diagram of a perspective view of an embodiment anemitter and a light emitter projecting light on the emitter and adetected light/reflection.

FIG. 6 depicts a diagram of a perspective view of an embodiment of atracking device for tracking a head of a user relative to a displaysystem.

FIG. 7 depicts a diagram of a perspective view of an embodiment of atracking device for tracking a head of a user relative to a displaysystem.

FIG. 8 depicts a diagram of a flow chart of an embodiment of a heuristiccorrespondence for a tracking device for tracking an object referencedto a display system.

While the invention is susceptible to various modifications andalternative forms, specific embodiments thereof are shown by way ofexample in the drawings and may herein be described in detail. Thedrawings may not be to scale. It should be understood, however, that thedrawings and detailed description thereto are not intended to limit theinvention to the particular form disclosed, but on the contrary, theintention is to cover all modifications, equivalents and alternativesfalling within the spirit and scope of the present invention as definedby the appended claims.

The headings used herein are for organizational purposes only and arenot meant to be used to limit the scope of the description. As usedthroughout this application, the word “may” is used in a permissivesense (i.e., meaning having the potential to), rather than the mandatorysense (i.e., meaning must). The words “include,” “including,” and“includes” indicate open-ended relationships and therefore meanincluding, but not limited to. Similarly, the words “have,” “having,”and “has” also indicated open-ended relationships, and thus mean having,but not limited to. The terms “first,” “second,” “third,” and so forthas used herein are used as labels for nouns that they precede, and donot imply any type of ordering (e.g., spatial, temporal, logical, etc.)unless such an ordering is otherwise explicitly indicated. For example,a “third die electrically connected to the module substrate” does notpreclude scenarios in which a “fourth die electrically connected to themodule substrate” is connected prior to the third die, unless otherwisespecified. Similarly, a “second” feature does not require that a “first”feature be implemented prior to the “second” feature, unless otherwisespecified.

Various components may be described as “configured to” perform a task ortasks. In such contexts, “configured to” is a broad recitation generallymeaning “having structure that” performs the task or tasks duringoperation. As such, the component can be configured to perform the taskeven when the component is not currently performing that task (e.g., aset of electrical conductors may be configured to electrically connect amodule to another module, even when the two modules are not connected).In some contexts, “configured to” may be a broad recitation of structuregenerally meaning “having circuitry that” performs the task or tasksduring operation. As such, the component can be configured to performthe task even when the component is not currently on. In general, thecircuitry that forms the structure corresponding to “configured to” mayinclude hardware circuits.

Various components may be described as performing a task or tasks, forconvenience in the description. Such descriptions should be interpretedas including the phrase “configured to.” Reciting a component that isconfigured to perform one or more tasks is expressly intended not toinvoke 35 U.S.C. §112, paragraph six, interpretation for that component.

The scope of the present disclosure includes any feature or combinationof features disclosed herein (either explicitly or implicitly), or anygeneralization thereof, whether or not it mitigates any or all of theproblems addressed herein. Accordingly, new claims may be formulatedduring prosecution of this application (or an application claimingpriority thereto) to any such combination of features. In particular,with reference to the appended claims, features from dependent claimsmay be combined with those of the independent claims and features fromrespective independent claims may be combined in any appropriate mannerand not merely in the specific combinations enumerated in the appendedclaims.

It is to be understood the present invention is not limited toparticular devices or biological systems, which may, of course, vary. Itis also to be understood that the terminology used herein is for thepurpose of describing particular embodiments only, and is not intendedto be limiting. As used in this specification and the appended claims,the singular forms “a”, “an”, and “the” include singular and pluralreferents unless the content clearly dictates otherwise. Thus, forexample, reference to “a linker” includes one or more linkers.

DETAILED DESCRIPTION Definitions

Unless defined otherwise, all technical and scientific terms used hereinhave the same meaning as commonly understood by one of ordinary skill inthe art.

The term “blob” as used herein generally refers to a sensor detectedsignal (e.g., reflection). The blob may be somewhat circular.

The term “connected” as used herein generally refers to pieces which maybe joined or linked together.

The term “coupled” as used herein generally refers to pieces which maybe used operatively with each other, or joined or linked together, withor without one or more intervening members.

The term “directly” as used herein generally refers to one structure inphysical contact with another structure, or, when used in reference to aprocedure, means that one process effects another process or structurewithout the involvement of an intermediate step or component.

The term “emitter” as used herein generally refers to a device whichprojects a signal (e.g., light, infrared light, etc.). The emitter maybe active (i.e., the signal originates from the emitter) or the emittermay be passive (i.e., the signal originate from somewhere other than theemitter and is, for example, reflected off the emitter).

The term “eyepoint” as used herein generally refers to the physicalviewpoint of a single eye or a pair of eyes. A viewpoint above maycorrespond to the eyepoint of a person. For example, a person's eyepointin the physical space has a corresponding viewpoint in the virtualspace.

The term “head tracking” as used herein generally refers to tracking theposition/orientation of the head in a volume. This allows the user to“look around” a virtual reality environment simply by moving the headwithout the need for a separate controller to change the angle of theimagery.

The term “position/orientation” as used herein generally refers maybereferred to herein as a position, but may be understood to meanposition/orientation in at least 2 degrees of freedom (e.g., onedimension position and one dimension orientation . . . X, rotation).Position/orientation may be relative or absolute, as desired.Position/orientation may also include yaw, pitch, and roll information,e.g., when defining the orientation of a viewpoint.

The term “referenced” as used herein generally refers to a known and/orcalculated (e.g., to a processor) precise position/orientation relationof a first object(s) (e.g., a sensor) to a second object(s) (e.g., adisplay device). The relationship, in some embodiments, may bepredetermined in that the relationship is fixed (e.g. physically fixedas in using precision spatial mounts) such that the relationship is notadjustable after initial assembly (e.g., wherein the first object andthe second object are assembled together as part of a single device).The relationship, in some embodiments, may be determined, during use,through a process (e.g., an initialization process, which may include acalibration and/or measurement process) which determines a precisespatial position/orientation relation of the first object(s) (e.g., asensor) to the second object(s) (e.g., a display device).

The term “sensor” as used herein generally refers to a converter thatmeasures a physical quantity and converts it into a signal which can beread by an observer or by an instrument. Sensors may include cameras,photo detectors, electronic sensors, CMOS or CCD sensors, etc.

The term “viewpoint” as used herein generally has the full extent of itsordinary meaning in the field of computer graphics/cameras. For example,the term “viewpoint” may refer to a single point of view (e.g., for asingle eye) or a pair of points of view (e.g., for a pair of eyes).Thus, viewpoint may refer to the view from a single eye, or may refer tothe two points of view from a pair of eyes. A “single viewpoint” mayspecify that the viewpoint refers to only a single point of view and a“paired viewpoint” or “stereoscopic viewpoint” may specify that theviewpoint refers to two points of view (and not one). Where theviewpoint is that of a user, this viewpoint may be referred to as aneyepoint. The term “virtual viewpoint” refers to a viewpoint from withina virtual representation or 3D scene.

This disclosure describes systems and methods for, in some embodiments,tracking a head of a user relative to a display system may includetracking device 100 which couples, during use, to a head of a user. Insome embodiments, the tracking device may include eyewear, headwear,armwear, handwear, object cover and/or other device that is to correlateto some object to be tracked. The tracking device may include first side110, second side 120, and at least three emitters 130. The second sidemay be opposite the first side. The second side may be directed, duringuse, towards the head of the user. The at least three emitters may bepositioned on the first side of the tracking device.

First side 110 may have a width 140 and a height 150. In someembodiments, the width may be greater than the height. In someembodiments, the tracking device may include a pair of glasses. FIG. 1depicts a diagram of a perspective view of an embodiment of trackingdevice 100 for tracking a head of a user relative to a display system.FIG. 1 depicts a tracking device set of eyewear used by the user with astereo three dimensional display with head tracking. The eyewearincludes a frame (155 a and 155 b) and within the frame is a lightabsorbing region (170 a, 170 b and 170 c). FIGS. 2-4 depict a diagram ofa perspective view of an embodiment of a system 300 for tracking a headof a user relative to a display system 400. For further descriptions ofa stereo display head/eye tracking system, that enables the display toconvey a scene or image (in mono or stereo) based on the real timeposition/orientation (and changing position/orientation) may be found inU.S. patent application Ser. No. 11/141,649 entitled “MULTI-PLANEHORIZONTAL PERSPECTIVE DISPLAY” filed May 31, 2005, U.S. patentapplication Ser. No. 12/797,958 entitled “PRESENTING A VIEW WITHIN ATHREE DIMENSIONAL SCENE” filed Jun. 10, 2010, U.S. Patent ApplicationNo. 61/426,448 entitled “THREE-DIMENSIONAL TRACKING OF OBJECTS IN A 3-DSCENE” filed Dec. 22, 2010, U.S. patent application Ser. No. 13/019,384entitled “MODIFYING PERSPECTIVE OF STEREOSCOPIC IMAGES BASED ON CHANGESIN USER VIEWPOINT” filed Feb. 2, 2011, U.S. Patent Application No.61/426,451 entitled “COLLABORATION SHARED PRESENCE” filed Dec. 22, 2010,each of which are incorporated by reference herein.

In some embodiments, the at least three emitters may include at leastfive emitters. The plurality of emitters 130 may include first emitter130 a, second emitter 130 b, third emitter 130 c, fourth emitter 130 d,and fifth emitter 130 e. The first emitter may be positioned towards anupper right side of the first side of the tracking device. The secondemitter may be positioned towards an upper left side of the first sideof the tracking device. The third emitter may be positioned towards alower right side of the first side of the tracking device. The fourthemitter may be positioned towards a lower left side of the first side ofthe tracking device. The fifth emitter may be positioned substantiallybetween the first emitter and the second emitter (e.g., on a bridgepiece of a pair of eyewear). In some embodiments, the emitters may belocated within a single plane. This may be due to the first side of thetracking device being substantially planar (e.g., as depicted in FIG.6). In some embodiments, at least some of the emitters may not liewithin a single plane. This may be due to at least the first side of thetracking device being substantially curved (e.g., as depicted in FIG.7).

In some embodiments, the tracking device uses emitters placed as farapart as possible within the tracking device. Emitters may be positionedwith as great a distance between each other to avoid interference withspecular reflections which may increase accuracy of the system. This wayas the user's head is turned in relation to a sensors, there will mostlikely still be at least three emitters able to produce a signal thatwould be sensed by the sensor(s). Distance between the emitters mayincrease assurance in angle measurement.

In some embodiments, a tracking device may include eyewear. Within thelight absorbing regions surrounding the emitters may be lenses (160 aand 160 b) of the eyewear, which may reflect the light emanating fromthe light source and/or other spurious light resulting in specularreflections.

In some embodiments, an emitter may emit light. The emitter may emitinfrared light. The emitter may emit light of any wavelength of range ofwavelength which may be detected by a sensor. In some embodiments, theemitter may emit a wavelength of light which does not fall within thevisible spectrum of light. Emitters that emit wavelengths of lightoutside the visible spectrum may do so such that a user wearing thetracking device is not distracted by visible light being projected bythe emitters. In other embodiments, an emitter may project a signalother than light (e.g., radio waves, etc.).

In some embodiments, the light projected from the emitter is reflectedlight. Reflecting light off of the emitters may have several advantagesover an emitter which acts as a source of a projected signal (e.g.,infrared light). An advantage includes that the tracking device does notrequire any kind of power source for the emitters since the emitters arepassive reflectors of signals. Certainly a complexity of the emitter andthe tracking device is reduced, facilitating manufacture and reducingcosts associate with development and manufacture. Emitters reflectingsignals may facilitate future upgrades in that different signals may bereflected off of the emitters as advancements or changes or made suchthat the tracking device does not have to be changed out (although theemitters themselves may have to).

The first side of the tracking device may include a signal (e.g., light)absorbing material 170 at least substantially surrounding at least oneof the emitters. These signal absorbing regions insure that, forexample, light hitting these regions does not reflect or is at leastinhibited from reflecting. In some embodiments, the light used is IRlight in that an IR light source projects IR light towards the trackingdevice and is reflected back. In this embodiment, the light absorbingregions are IR light absorbing regions. Within the light absorbingregions emitters may be positioned that are intended to reflect thelight emanating from the signal source. In some embodiments, all or atleast a majority of a first side of the tracking device may be coatedand/or formed from a signal absorbing material. In some embodiments,only a portion of a surface surrounding an emitter on a tracking deviceis configured to absorb a signal which the emitter is configured toreflect.

In some embodiments, the amount of light reflected from a surfacedepends on the smoothness of the surface (i.e., a smooth surfacereflects more light than a rough surface, and a rough surface mayreflect more diffusely than a smooth surface). The amount of lightabsorbed may depend on the color of the surface (i.e., dark coloredsurfaces absorb light better than light colored surfaces). For example,rough, black surfaces may absorb visible light best of all.

An angle at which light strikes the object has an effect on the amountof light absorbed and/or reflected. If the light strikes the surfacenormal to the surface or at a 90 degree angle to the surface plane,absorption is favored and reflection less favored. If the light strikesthe surface at a low angle, reflection is favored over absorption(depends on the Brewster angle and index of the material).

The signal one wishes to absorb naturally will dictate the method orsystem used to absorb the signal. For example infrared radiation is notnecessarily absorbed by the same materials that absorb visible light.

In some embodiments, an emitter may include a width 180, a height 190,and a depth 200 as depicted in FIG. 5. The depth may be such that theemitter extends away from the first side of the tracking device. Atleast one of the emitters may include a substantially cylindrical,spherical, and/or hemi-spherical shape. FIG. 5 depicts a diagram of aperspective view of an embodiment of cylindrical emitter 130 and a lightemitter 210 projecting light on the emitter and a detectedlight/reflection blob 225. In some embodiments, the emitters arecylindrical such that when a signal reflects off the emitters, they mayappear as a circular blob to a sensor. This may assist when the trackingdevice turns relative to the light emanating source and/or sensors, sothe reflection at different angles are still seen by the sensor(s) ascircular blobs. Further the emitters may be of a known size, which maybe programmed into the sensor processor enabling the sensor processor tobetter identify the true intended reflections from spurious reflections(e.g., from lenses in a tracking device). With the cylindrical shape ofthe extended emitters, turning of a user's head relative to sensorswould still allow the emitters to be sensed by the sensor(s) independentof eyewear curvature (for example, a more stylized eyewear trackingdevice) or minor obstructions (e.g. the user's nose). FIGS. 6 and 7depict a diagram of a perspective view of embodiments of trackingdevices 100 with cylindrical emitters 130 for tracking a head of a userrelative to a display system. The tracking devices in FIGS. 6 and 7depict different styles of eyeglasses frames. At least one of theemitters may include a substantially elliptical shape. At least one ofthe emitters may include a substantially spherical, and/orhemi-spherical shape.

In some embodiments, the emitters may be couplable to the first side ofthe tracking device such that a user may decouple the emitters from thefirst side. Emitters may be removable from the tracking device. A useror qualified technician may be able to attach, remove, and/or replaceemitters on a tracking device. Replaceable emitters may allow forreplacement of soiled and/or defective emitters with new functioningemitters. Replaceable emitters may allow for replacement with newer moreeffective and/or redesigned emitters. Removable emitters may allow morethan one user to wear a tracking device, wherein a first user wears atracking device with emitters and a second user wears a tracking devicewithout emitters (e.g., emitters have been removed by the second user).In some embodiments, only one user of a plurality of users may wearing atracking device and watching a display system may have emitters coupledto their tracking device, such that a detection system does not have tocontend with more than one set of emitters competing with each other andpotentially confusing the detection system with how to adjust thedisplay system with respect user(s). The second user may wear a trackingdevice for other benefits besides being tracked (e.g., using lenses inthe tracking device to view three dimensional images created by thedisplay system).

In some embodiments, emitters may be couplable to a tracking deviceusing a number of known common coupling methods. In some embodiments, anemitter may be coupled to a tracking device using an adhesive. Theadhesive may be strong enough to couple an emitter to a tracking devicefor extended periods of time. The adhesive may not be so strong that auser may not be able to later decouple the emitter from the trackingdevice for reasons described herein. In some embodiments, an emitter maybe coupled to a tracking device using a hook and loop coupling system.In some embodiments, an emitter may be coupled to a tracking deviceusing a one or more magnets. In some embodiments, an emitter may becoupled to a tracking device using a friction fit system.

In some embodiments, a plurality of emitters may be coupled to atracking device as a single unit. For example, in an embodiment wherethere are five emitters coupled to a tracking device, the five emittersmay be coupled to a single member which is itself couplable to thetracking device. In such embodiments, a single member facilitatescoupling and removing emitters by a user, instead of having toremove/couple multiple emitters, as well as keep track of them whendecoupled. The member may be coupled to the tracking device using atleast any of the methods discussed herein with relation to coupling theemitters to the tracking device.

In some embodiments, a system may include detection system 310. Thedetection system may be associated with a display system 400. Displaysystem 400 may include a three-dimensional display system. The displaysystem may include a display device. The display device may image,during use, a first stereo image conveying a three dimensional scene(“Stereo Image”). The system may include an image processor. The imageprocessor may generate, during use, the first Stereo Image. In someembodiments, the first Stereo Image may be from a first perspective. Thedetection system may include sensors 320 which detects, during use,signal 330 (e.g., light). The detection system may include at least twosensors (e.g., 320 a and 320 b) which detect signals (e.g., 330 a and330 b respectively) projected by emitters 130. Having at least twosensors may allow for the accurate assessment of a depth or z-distanceof the emitters with reference to the display system. A depth may beassessed using triangulation. In some embodiments, sensors may includecameras, photo detectors, electronic sensors, CMOS, or CCD sensors, etc.The detection system may include a processor. The processor may beelectrically coupled to the sensor. Having at least two sensors mayallow geometric triangulation of emitters detected by the sensors usingthe processor. In some embodiments the processor(s) and sensor(s) mayhoused in single device 340 which is then coupled to a display system.The sensors may be coupled to the display system such that theposition/orientation of the display system relative to the sensors isknown such that the processor is able to assess the position orientationof the tracking device relative to the display system. In someembodiment, the display system may be positioned independently from thetracking device and the user of the tracking device, in that a trackingsystem may not be necessary for a display system which is wearable orcoupled to the user. In some embodiments, the sensor(s) and theprocessor(s) may be housed in separate devices. In some embodiments,substantially all portions of a system may be housed in a single device(including a projection device, but excepting for the tracking deviceitself).

In some embodiments, the processor may assess, during use, if the firstside of the tracking device is directed towards the display system and aposition of the first side of the tracking device relative to thedisplay system when the first side of the tracking device is directedtowards the display system. The processor may assess, during use, thefirst side of the tracking device is directed towards the display systemwhen the sensor detects light emitting from at least three of theemitters (e.g., five as depicted in FIGS. 3-4). In some embodiments, theprocessor may assess, during use, the first side of the tracking deviceis directed towards the display system when the sensor detects a signal(e.g., light) emitting from all of the emitters (e.g., five as depictedin FIG. 2) positioned on a tracking device. The processor may beprogrammed with a minimum numbers of emitters which must be detectedbefore proper position/orientation information may be determined, whichin turn may determine the image projection projected by the displaysystem. In some embodiments, a minimum number of emitters may include atleast three emitters. At least three of the emitters may benon-collinear. Three non-collinear points define a plane in space andallow a processor to assess a position/orientation of the surface towhich the non-collinear emitters are coupled.

In some embodiments, the detection system may include a signal emitterwhich projects a signal such that the signal is reflected, during use,from at least one of the emitters. In some embodiments, the signalemitter includes a light emitter (e.g., infrared light, etc.). In someembodiments, a signal emitter may be positioned adjacent a sensor. Oneor more signal emitters may be positioned substantially adjacent eachsensor. Sensors from the detection system may then detect the reflectedlight. The emitters may be of a size that is known (programmed into) tothe detection system such that the detection system is able to assessthe likelihood that a detected reflection is from the emitter(s) or fromsome spurious source (e.g., specular reflections such as reflectionsfrom lenses positioned in the tracking device). In some embodiments, theemitters may be placed within the borders of a first side of eyeglassframe 155 of tracking device 100, such that there is a segment of thelight absorbing material between the reflectors and the lenses of thetracking device. This way the detection system may sense more lightreflections than that of the emitters, but with the light absorbingregions between the emitters and the lenses, there is a greaterlikelihood of distinguishing reflector light and unintended lightreflected off the lenses, for example.

In some embodiments, the emitters may be placed on the boundary regionof the eyewear with a light absorbing region between the emitters andthe eyewear lenses to provide a more distinct demarcation between theintended reflections from the emitters and the spurious one (e.g., fromthe lenses). In one embodiment the lenses may be absorbing in thegeneral wavelength of the light source to establish a more distinctcontrast for the sensor and detection system.

In some embodiments, a system may include a surface including at leastthree emitters. More than three emitters (e.g., 4, 5, or 6 emitters) maybe used to provide further validate of an assessed position/orientationof the surface. The surface may be positionable, during use, withreference to the display device, where the display device is correlatedto the sensors. In some embodiments, the surface may be positioned withat least 6 degrees of freedom of movement proximate to the displaydevice. The system may include at least two sensors. At least twosensors may be coupled to the display device in a known position andorientation with reference to the display device. At least two of thesensors may detect, during use, light received from at least three ofthe emitters as light blobs when the light blobs from the at least threeemitters of the surface are detected substantially in proximity to thedisplay device during use.

The processor may assess, during use, a referenced position of thedetected light blobs using a bounding function (e.g., convex hull) foreach of at least two of the sensors (doing this may assist in excludingmany spurious blobs resulting from specular reflections). The processormay correlate, during use, the assessed referenced position of thedetected light blobs for each of at least two of the sensors such that aposition/orientation of the surface with reference to the display deviceis assessed. In some embodiments, when the processor correlates theassessed referenced position of the detected light blobs the processormay identify a first emitter along a perimeter determined by thebounding function by assigning a first detected light blob closest to apredetermined first portion of the perimeter (e.g., lower left corner ofthe convex hull). The processor may employ an algorithm which follows ina first direction away from the first emitter along the perimeterassessing relative angles formed by adjacent detected light blobs alongthe perimeter such that a second emitter is identified. The processormay identify an at least third emitter along the perimeter withreference to the identified first and second emitter.

In some embodiments, the processor may verify the assessed referencedposition of the detected light blobs per sensor by comparing theassessed relative position of the detected light blobs to a database ofdifferent configurations of emitter light blobs.

FIG. 8 depicts a diagram of a flow chart of an embodiment of a heuristiccorrespondence method 500 for a tracking device for tracking an objectreferenced to a display system. The processor may use the method toidentify emitters and the emitter's position and orientation.Correspondence method 500 may be directed towards an embodiment withfive emitters (e.g., as depicted in FIG. 1), but may be expanded toinclude more or fewer (at least three) emitters. A bounding function(e.g., convex hull) may produce 510 a list with all the blobs on theperiphery of an image produced by a sensor. The blobs may correspond tothe emitters in the image from the sensor plus any spurious blobs due tospecular reflections (e.g., from lenses). The bounding function mayfunction eliminate at least some of extraneous blobs due to specularreflections.

Method 500 may include identifying 520 a lower left blob on the imageand labeling the blob as lower left emitter 130 d on the glasses. Themethod may include moving 530 around the convex hull indices inclockwise fashion and compute angles amongst adjacent blobs. When onefinds a “right turn” or 90 degree angle 540 amongst three adjacentblobs, then the processor declares that blob the upper left blob and itis labeled emitter 130 b. For the right side of the glasses theprocessor used the method to find the lower right blob 550 and labelthis blob emitter 130 c. The method may include moving 560 around theconvex hull indices in counter-clockwise fashion and compute anglesamongst adjacent blobs. When one finds a “left turn” or 270 degree angle570 amongst three adjacent blobs, then the processor labels that blobthe upper right blob and it is labeled emitter 130 a.

Heuristic correspondence method 500 may include validating 580 theidentification of the left and right side emitters. Validation mayinclude comparing the relative position of the two emitters on the leftside to one another as well as doing the same for the right sideemitters. For example, the left blobs ought to be roughly vertical andthe right blobs ought to be roughly vertical. In some embodiments, themethod may include validating the assessed referenced position of thedetected light blobs by comparing the assessed referenced position ofthe detected light blobs to a database of different configurations ofemitters. If both left and right corner blobs (e.g., emitters 130 b and130 a) are valid, then a blob is roughly positioned at the geometriccenter between the corner reflectors 590. The middle blob may be labeled600 as emitter 130 e. Final validation 610 of position of middle emitter130 e may be achieved by comparing with known dimensions of object andblob locations.

In some embodiments, one may roughly estimate position by extrapolatingfrom known blob locations & known object (e.g., glasses) size.

Method 500 or similar methods may be performed using a heuristicalgorithm that corresponds the detected blobs to known geometricarrangements of emitters on the tracked surface, such that which blobcorresponds to which emitter is identified. Upon the system identifyingat least three non-collinear emitters, the system is able to assess thespatial coordinates (e.g., X, Y, and Z) for the identified emittersusing geometric triangulation from at least two sensors. Once thespatial coordinates of the at least three non-collinear emitters isascertained the pitch, yaw, and roll may be assessed.

In some embodiments, the processor may assess, during use, aposition/orientation of a head to which the surface is coupled to usingthe assessed position/orientation of the surface with reference to thedisplay device, and wherein the processor assesses, during use, aviewpoint using the assessed position/orientation of the head to assessa second perspective for use by the image processor to assist ingenerating the second Stereo Image.

The image processor may generate, during use, a second Stereo Imageusing the assessed position/orientation of the surface with reference tothe display device. In some embodiments, the first Stereo Imagegenerated may be from a first perspective. The first Stereo Image may bedistinct from the second Stereo Image wherein the second Stereo Imagemay be derived from a second perspective, that correlating to the secondhead position, which is in respect to the second surfaceposition/orientation. In some embodiments, the first Stereo Image maygenerated using a first assessed position/orientation of the surfacewith reference to the display device and the second Stereo Image may begenerated using a second assessed position/orientation of the surfacewith reference to the display device. Stereo Images may be continuouslygenerated during use with each Stereo image derived from a new assessedposition/orientation of the surface with reference to the displaydevice.

In another embodiment, the detection system may assess the outerperimeter of a blob field. This outer perimeter may form the convex hullthat is used to qualify the perimeter and hence the boundary from whichto register the intended blobs. With the convex hull, the spurious blobsdetected within the convex hull are assumed to be spurious reflectionsand not those that are used to determine position and/or orientationinformation of the user's tracking device. To help reduce the likelihoodof spurious blobs emanating from the lenses, the lenses may be curved todisperse the light reflections thereby reducing the likelihood of strongblobs emanating from the lenses of the tracking device. By having, insome embodiments, one reflector dot on the nose bridge and two each onthe top and bottom outer edges of each lens, the head tracking systemhas better recognition of the eyewear position.

In this patent, certain U.S. patents, U.S. patent applications, andother materials (e.g., articles) have been incorporated by reference.The text of such U.S. patents, U.S. patent applications, and othermaterials is, however, only incorporated by reference to the extent thatno conflict exists between such text and the other statements anddrawings set forth herein. In the event of such conflict, then any suchconflicting text in such incorporated by reference U.S. patents, U.S.patent applications, and other materials is specifically notincorporated by reference in this patent.

Further modifications and alternative embodiments of various aspects ofthe invention will be apparent to those skilled in the art in view ofthis description. Accordingly, this description is to be construed asillustrative only and is for the purpose of teaching those skilled inthe art the general manner of carrying out the invention. It is to beunderstood that the forms of the invention shown and described hereinare to be taken as the presently preferred embodiments. Elements andmaterials may be substituted for those illustrated and described herein,parts and processes may be reversed, and certain features of theinvention may be utilized independently, all as would be apparent to oneskilled in the art after having the benefit of this description of theinvention. Changes may be made in the elements described herein withoutdeparting from the spirit and scope of the invention as described in thefollowing claims.

What is claimed is:
 1. A system for tracking with reference to athree-dimensional display system, comprising: a display device whichimages, during use, a first stereo three-dimensional image; a surfacecomprising at least three emitters, wherein the surface is positionable,during use, with reference to the display device; at least two sensorscoupled to the display device in a known position and orientationreferenced to the display device, wherein at least two of the sensorsdetect, during use, light received from at least three of the emittersas light blobs when the light blobs from the at least three emitters ofthe surface are detected substantially in proximity to the displaydevice during use; a processor coupled to at least two of the sensors,wherein the processor assesses, during use, a referenced position of thedetected light blobs using a bounding function for each of at least twoof the sensors, wherein the processor, correlates, during use, theassessed referenced position of the detected light blobs for each of atleast two of the sensors such that a first position/orientation of thesurface with reference to the display device is assessed; and an imageprocessor which generates, during use, the first stereothree-dimensional image using the assessed first position/orientation ofthe surface with reference to the display device.
 2. The system of claim1, wherein the surface comprises at least 6 degrees of freedom ofmovement proximate to the display device.
 3. The system of claim 1,wherein the surface comprises at least four emitters, and wherein atleast two of the sensors detect, during use, light received from atleast three of the emitters as light blobs.
 4. The system of claim 1,wherein the surface comprises at least five emitters, and wherein atleast two of the sensors detect, during use, light received from atleast three of the emitters as light blobs.
 5. The system of claim 1,wherein the first stereo three dimensional image is from a firstperspective with the first stereo three dimensional image is distinctfrom a second stereo three-dimensional image which is derived from asecond perspective using a second assessed position/orientation of thesurface with reference to the display device.
 6. The system of claim 1,wherein at least a portion of the surface adjacent to at least one ofthe emitters absorbs light.
 7. The system of claim 1, wherein thesurface forms at least a portion of a device which couples to the headof a user.
 8. The system of claim 1, wherein the surface forms at leasta portion of a pair of glasses which couple to the head of a user. 9.The system of claim 1, wherein the emitters at least partially extendfrom the surface.
 10. The system of claim 1, wherein at least one of theemitters comprises a substantially cylindrical, spherical, and/orhemi-spherical shape.
 11. The system of claim 1, wherein at least two ofthe sensors detect, during use, infrared light projected from at leastthree of the emitters as light blobs when at least three of the emittersof the surface are directed substantially towards the display deviceduring use.
 12. The system of claim 1, wherein at least two of thesensors detect, during use, light reflected from at least three of theemitters as light blobs are detected substantially in proximity to thedisplay device during use.
 13. The system of claim 1, wherein when theprocessor correlates the assessed referenced position of the detectedlight blobs the processor: identifies a first emitter along a perimeterdetermined by the bounding function by assigning a first detected lightblob closest to a predetermined first portion of the perimeter; moves ina first direction away from the first emitter along the perimeterassessing relative angles formed by adjacent detected light blobs alongthe perimeter such that a second emitter is identified; and identifiesan at least third emitter along the perimeter with reference to theidentified first and second emitter.
 14. The system of claim 1, whereinthe processor verifies the assessed referenced position of the detectedlight blobs per sensor by comparing the assessed relative position ofthe detected light blobs to a database of different configurations ofemitters.
 15. The system of claim 1, wherein the processor assesses,during use, a first position/orientation of a head to which the surfaceis coupled to using the assessed first position/orientation of thesurface with reference to the display device, and wherein the processorassesses, during use, a first viewpoint using the assessed firstposition/orientation of the head to assess a second perspective for useby the image processor to assist in generating a second stereothree-dimensional image.
 16. A method for tracking with reference to athree-dimensional display system, comprising: positioning a surface withreference to a display device, wherein the surface comprises at leastthree emitters; detecting light received from at least three of theemitters as light blobs when the light blobs from the at least threeemitters of the surface are detected substantially in proximity to thedisplay device using at least two sensors coupled to the display devicein a known position and orientation with reference to the displaydevice; assessing a referenced position of the detected light blobsusing a bounding function for each of at least two of the sensors usinga processor coupled to at least two of the sensors; correlating theassessed referenced position of the detected light blobs for each of atleast two of the sensors such that a first position/orientation of thesurface with reference to the display device is assessed; generating afirst stereo three-dimensional image on the display device using animage processor, wherein the image processor uses the assessed firstposition/orientation of the surface with reference to the display deviceto generate the first stereo three-dimensional image; and generating asecond stereo three-dimensional image on the display device using theimage processor, wherein the image processor uses an assessed secondposition/orientation of the surface with reference to the display deviceto generate the second stereo three-dimensional image.
 17. The method ofclaim 16, wherein correlating the assessed referenced position of thedetected light blobs comprises: identifying a first emitter along aperimeter determined by the bounding function by assigning a firstdetected light blob closest to a predetermined first portion of theperimeter; moving in a first direction away from the first emitter alongthe perimeter assessing relative angles formed by adjacent detectedlight blobs along the perimeter such that a second emitter isidentified; and identifying an at least third emitter along theperimeter with reference to the identified first and second emitter. 18.The method of claim 17, wherein the second emitter is identified as asecond detected light blob of three adjacent detected light blobsforming a substantially right angle.
 19. The method of claim 17, furthercomprising verifying the assessed referenced position of the detectedlight blobs by comparing the assessed referenced position of thedetected light blobs to a database of different configurations ofemitters.
 20. The method of claim 17, further comprising absorbing lightusing at least a portion of the surface substantially adjacent to atleast one of the emitters.